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Abstract 

Marroquin and Ramirez (1990) have recently discovered a class of 
discrete stochastic cellular automata with Gibbsian invariant measure 
that have a non-reversible dynamic behavior. Practical applications 
include more powerful algorithms than the Metropolis algorithm to 
compute MRF models. In this paper we describe a large class of 
stochastic dynamical systems that has a Gibbs asymptotic distribu- 
tion but does not satisfy reversibility. We characterize sufficient prop- 
erties of a sub-class of stochastic differential equations in terms of the 
associated Fokker-Planck equation for the existence of an asymptotic 
probability distribution in the system of coordinates which is given. 
Practical implications include VLSI analog circuits to compute cou- 
pled MRF models. 
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It is well known (see Stratonovitch, 1963, for instance) that one can as- 
sociate, under some conditions, to a stochastic continuous automata (i.e., a 
stochastic differential equation) a so-called Fokker-Planck (F-P) equation in 
the probability distribution of the state variables. In this note, we wish to 
characterize conditions under which the F-P equation admits a stationary 
solution of the Gibbs type. 

Let x a n-dimensional vector of state variables, and VF(x, t) the proba- 
bility distribution of the state variables described by x at time t. The F-P 
equation is: 



where d a (x.) is the drift vector and K a @{x) is the diffusion matrix (see Stratonovitch, 
1963, p. 76). 

The stationary solution u;(x) of the F-P satisfies the equation: 

E^(x) = o, (i) 

a = l U ° 

where we have defined the probabiiity current G„(x): 

1 d 

G„(x) = o?„( x M x ) - 7T a — K a/ 3(x.)w(x.) . (2) 
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In order to find the stationary solution, we do not assume, as Stratonovitch 
and everybody else does, that G a (x.) = and set w(x.) = e~ ^ x ^ in equation 
(1), obtaining: 

£ 4~ (d a (x)e- u n - ~e- p %(x)) = 
~^ ox a \ zdxp J 

= t £«-"<■" (<U*) + 5**(*>^'(*) - 5^(x)) = o 

Assuming that the diffusion matrix is constant, that is K a @{x) = K a p, we 
obtain: 
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Provided that the diffusion matrix K is invertible we can effectuate the co- 
ordinate transformation 

x a -+ -Kp a x p 
and defining the vector (d)„ = d a (x.) we rewrite the previous equation as 

-VU -d-VU-VU + V-d + V 2 U = 

= -VU{d + W) + V(d + W) = . 
We finally obtain 

(V- W)-(W + d) = 0, (3) 

which is the condition for stationary distribution. 
Thus, one solution is: 

W + d = 0«=d = -W, (4) 

which is equivalent to the so called potential conditions, that amount to say 
that d is the gradient of a potential. If the potential conditions are satisfied 
the probability current G a (x.) is identically zero, and thus detailed balance 
holds. Therefore we recover the well known result that detailed balance im- 
plies the existence of a stationary Gibbs distribution w(x.) = e~ u ( x \ However 
condition (3) shows that the converse is not true. In fact equation (3) has 
also the solution 

(V-W)-f = 0, (5) 

with f = VU + d and this solution is not trivial only if f ^ 0, that is if d is 
not the gradient of a function. Equation (3) has therefore a "larger" space of 
solutions than the one represented by the potential conditions. Of course in 



both cases the solution U must be such that u;(x) = e u ( x > is a probability 
distribution, and therefore the following additional condition must hold: 



I Jx e~ u W < oo 



A simple and interesting example that proves the existence of non-trivial 
solutions U such that u;(x) = e~ u ( x > is the following. 

Example of existence 

Consider the stochastic differential equation in 1Z 2 



ix = -2x + y + £ x (t) 
\y = -x-2y + ( y (t) 

where £ x (t) and £ y (t) are Gaussian noise terms, that i 



(6) 



< UW) > = < &(*)&(*') > = 26(t - t') . 
The F-P equation associated to (6) is 

JV(x, t) = - V • ( W(x, t)d(x)) + 2V 2 W/(x, t) 

where the drift vector is d(x) = (— 2x + j/, —x — 2y). It is easy to verify 
that d(x) is not a conservative held, so that detailed balance does not hold. 
However a stationary solution of the F-P exists, with u;(x) = e~ u ( x > and 

U{x) = x 2 + y 2 . 
In fact, defining f = V?7 + d we have 

f = (2x - (2x - y ),2y-(x + 2y)) = (y, -x) 
and therefore equation (5) is satished, since 

(V - W) -f = V-f-Vt/-f = 2(x, y) ■ (y, -x) = . 

Notice that in absence of noise the differential equation (6) is linear, with 
characteristic eigenvalues A = — 2 ± z, and the associated trajectories are 
inward spirals. This makes perfectly plausible the fact that, in presence of 



noise, the probability distribution of the variables is a Gaussian centered in 
the origin. 

Remarks: 

• In the linear case, that is when d(x) = Ax and A is a symmetric matrix, 
detailed balance always holds, because d = —VU with U(x.) = — |xAx. 
However the stationary solution u;(x) = e~ u ( x > exists only if the matrix 
A is negative definite, that is if u;(x) is integrable. 

• Stratonovitch (1963, p. 79) says that even when potential conditions 
are not met but d is a linear function of x and K a p(x) are independent 
of x, the F-P equations can be solved. In fact it is easy to see that 
if d(x) = Ax and A is not symmetric the potential conditions do not 
hold but the function U(x.) = — |xAx is a solution of equation (5). 

• If the forces d a in the Langevin equation are conservative, i.e., d = 
— V£7, then, if the fluctuations are thermic-like, detailed balance is sat- 
isfied and a Gibbs stationary distribution exists (Equation 4 is satis- 
fied). 

• It appears that our results may be derivable from the formulation of 
Graham (1980) and the more general case considered by Jauslin (1984) 
and Zeeman (1988). An in-depth analysis of many properties of the 
Fokker-Planck equation relevant for this note can be found in Tan and 

Wyatt (1985). 
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